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(54) Method and apparatus for automatic inspection of moving surfaces 

(57) In a method and an apparatus for automatic - V 

inspection of moving surfaces the surface (S) to be 
inspected is observed under a first observation condi- ' - 
tion by'means of a first illumination76bservation fchannel 
to obtain" a" first signal (R), and the surface (S) is 
observed; under a second observation; condition by 
means of ;a second and a third illumination/obserVation 
channel to obtain a second signal (G) and a third signal 
(B), and from the first, second and Ihirdsignals (R; G, B) 
informations on the physical properties of the surface 
(S) : is derived.:, , 
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Description 

[0001 ] The present invention relates to a method and 
to an apparatus for automatic inspection of moving sur- 
faces, in particular to a method and an apparatus for 
automatic inspection of moving surfaces for applications 
such as the inspection of steel strips, wood, leather or 
tiles. Even more particular the present invention relates 
to a method and an apparatus for automatic inspection 
of moving surfaces using at least three different illumi- 
nation/observation channels. ■ - 
[0002] Products like the above-nrientioned steel strips, 
wood, leather or tilfes are typically -produced at high 
speed in a continuous 1 process arid they- have to be 
inspected during motion. The defects which have to be 
detected and classified automatically are anomalies in 
the surfaces with respect to e.g. reflectivity, color; gloss- 
iness, texture ! arid the 3D-profile.of -the surface under 
inspection.-' " : ' 

[0003] In the prior art/ systems.for automatic surface 
inspection are well established arid used for industrial 
applications such as 1 the inspection "of steel . tiles dr 
wood. The applied, cameras are monochrome or color 
line scan cameras, For illumination fluorescent tampfe, 
halogen lamps or fiber optic illuminators aVe corrtmortiy 
used. The defects to be detected arid classified are 
scratches,-dents, knots and the -like as defined by the 
application: Typically these defects niarirfest themselves 
in different ways, ag. ^deviations of reflectivity, glossi- 
ness, color; texture or the ; 3 D-profiie 6f the surface 
under inspection. r. ; • - > 

[0004] A critical part in the system design is to define 
the apparatus for image acquisition, including the selec- 
tion of a r camera and the illumination system, arid* to 
determine the geometrical relations of the components. 
The aim is to achieve images from the surface which 
contain the necessary information to detect and to dis- 
tinguish all of the defects-autbmatically, including 3D- 
defects.- ln many cases the resuft is disappointing. The 
reason is simply that monocular images do not contain 
reliable and 'unambiguous information onthe 3 D-profiie 
and glossiness of the surface. To overcome this problem 
a multi-camera setup is used in 1 some applications ' by 
means of'which the surface is inspected under different 
viewing conditions simultaneously -In such setu^Si -typi- 
cally two monochromatic cameras and one 5 illuminator 
are used to obtain bright and dark field images of the 
same object. ' " L ^ " - r 

[0005] "These setups-suffer from a number of short- 
comings: the alignment' of two line scan cameras is dif- 
ficult, and the mechanical constructions for these 
systems become heavy. — ' " 
[0006] In the article by R. J. Woodham, "Photometric 
Method for Determining Surface Orientation from multi- 
ple Images", in Optical Engineering Vol. 19, 191, pp. 
139 to 144, 1980, a photometric stereo technique is 
described". The principle of this technique is to take mul- 
tiple images from the same object and with the same 
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camera, and to vary the direction of the incident illumi- 
nation between successive images, while holding the 
viewing geometry constant. This provides sufficient 
information to determine the surface orientation, i.e. to 

5 gather 3D-information, of each surface element of the 
inspected object at each image point 
[0007] The technique is named photometric stereo 
because it uses the radiance values recorded at a sin- 
gle pixel location in successive views, rather than the 

10 relative positions of displaced features in binocular 
stereo. Since the viewing geometry in this technique is 
riot "changed, the correspondence between pixels in the 
taken set of images is known a priori. 
[0008] The photometric stereo method requires that 

is the inspected object is resting, giving time to switch the 
lamps and to take the images, and that the reflectance 
distribution of the surface is known. Therefore, the 
method' cannot be applied for inspection of moving 
materials and surfaces of unknown reflectivity. 

20 [0009] DE 195 1 1 534 A1 relates to a method and an 
apparatus for detecting 3D-defects, such as dents and 
steps in a: flat surface, in applications for automatic sur- 
face inspection, following the idea of photometric 
stereo!* The surface under inspection is simultaneously 

25 illuminated witrTat least two lamps from different direc- 
tions under dark field conditions, where the light from 
the lamps has different colors. A color line scan camera 
is "used for-'iriiage acquisition and ~ 3D<lefects are 
detected by analyzing the measured color values. 

so [0010] This method yields information on 3D-defects 
but not oh- glossiness and" reflectivity of the surface 
because a symmetrical dark fi6ld illumination is used. 
Therefore, the capabilities for discriminating between 
different types^ of defects' are 1 limited. Furthermore, 

35 defect detection is done by a 1 color classifier. Using this 
method it is not possible to adapt to a changing appear- 
ance of the inspected surface or ; to changes of the illu- 
mination. In practical applications, the sensitivity for 
defect detection is limited. ' - f *' > 

40 ' [0011] "* EP 0-764 845 A2 describes^an apparatus for 
image acquisitrori-which is" similar to the 6ne described 
in DE 195 1 1 534 A1 , but the method for the detection 
of-3D-defects is only-based' bn 'shadows, which can be 

- ' observed at the' edgeis of steps in the surface. 

45 [0012]- In the article by M! Magee et'ai:; "Identification 
of Flaws in Metallic Surfaces Using Specular and Dif- 
fuse Bispectraf Light Sources" in SPIE, VoIP 1825, Intel- 
ligent Robots and Computer Vision XI/ pp. 455 to 468, 
1 992, a method for identification of flaws in metallic sur- 

so faces is described. The aim of this method is to enhance 
contrast and detection rate for scratches during auto- 
matic surface inspection of resting cast metal parts. The 
. object under inspection is illuminated with light of differ- 
ent colors: therels one channel for a dark field using a 

55 very shallow angle of incidence and one channel for 
bright field. The used effect is that the light from the 
shallow dark field illumination will be scattered by sharp 
edges of the scratches and therefore scratches will look 
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dark in the bright field and bright in the dark field. A sec- 
ond channel for dark field illumination is missing and it is 
therefore not possible to estimate the slope of surface 
elements on surfaces with, varying glossiness and 
reflectivity. : . , r 

[001 3] Starting from this prior art it is the object of the 
present invention to provide an enhanced method and 
apparatus for automatic; inspection of surfaces which 
enables the inspection of surfaces with ^enhanced reliar 
bilrty at less false alarm rates.- j :.mk\. 
[0014] This object is achieved by a method according 
to claim 1 and by an apparatus according tO;ctairn r T2.: f 
[0015] The present -invention provides a .method vfor 
automatic inspection of moving surfaces using at least 
three different illumination/observation channels, i \said 
method comprising the steps of : ■ ... . ... : 

a) observing a surface element of said surface to be 
inspected under a. first observation condition ^by 
means of a first of said at least three different illumi- 
nation/observation channels toobtain atirst,signal; 

- b) observing said surface element under a second 
observation condition by means of a second and a 
-. : third ,of said at least . three- different ; illumina- 
. . tion/observation channels to, obtain a second signal 
and a thircj signal; and ^ *»r-< • r.r^- 

■ ; i o<c;: '! f : o ' ■:• *™ j- sri; 

c) deriving from said first,; second, and; third signals 
a physical property of said surface dement - 5 : , 

[0016] . The present inventipnrprovides-an t . apparatus 
for automatic inspection of t moving surfaces, comprising 

a first illumination/observation channel for obsery- 
• ing a -surface ^element oi said < surface \o be 
inspected under ; a^first observation condition, to 
obtain a first signal; - -rsr-b 

a second illumination/obseryation v rc6annel -for 
observing said surface; element- under a .second 
observation- condition :tq> obtain a-^ecpnd SjjgnaJ; ■ ..* 

-v. ■ f . .. : : - M * - ' ^ r r .: I: 3 a 
a third illumin^tipn/ob^ery^on channeyor observ- 
ing said surface e.lernerrt untfer saijd s^cgnd obser- 
■ • f . vatiorv condition tQ obtain a.:third signal ;-and _ c % 

means for deriving a physical property of said sur- 
face element from said first, second andthird sig- 
nal. r : ~ - 1 

[0017] The.present invention provides a method and 
an apparatus . for automatic surface, inspection which 
makes it possible to extract and to process information 
. on the physical properties of the surface, like reflectivity, 
glossiness and slope of surface elements separately 
The advantage is .that especially 3D-defects can be 
detected and classified with high reliability .even in tex- 



tured surfaces. Applications are e.g. the inspection of 
steel, leather, wood, extruded profiles or other materi- 
als, which are produced in a continuous process with a 
high speed and have to be inspected during motion. 

5 [0018] The present invention. is based on the idea of 
photometric stereo. Information on reflectivity, color, 
glossiness and profile of the inspected surface is cap- 
tured, e.g. by an apparatus comprising a color line scan 
camera^ and at least three spatially separated light 

io sources with- different spectral characteristics. The 
result of the image acquisition are registered images, 
e.g. R-, G-, B-images ( basically corresponding to the 
channels oftilluminatioru /These images are processed 
iij, several steps-comprising estimation of physical prop- 

is ertieS'for each surface ?element, detection of surface 
anomalies, feature-extraction and classification. 
[0019], . , According to a preferred embodiment of the 
present invention the first iljumination/observation chan- 
nel js formed by a light sensitive sensor device and a 

20 first light source, the second illumination/observation 
channeU.s for : med by-the same light sensitive sensor 
device and:by:a .second light source, and the third illurrti- 
nation/observatipn. channel is formed by the same light 
sensitive sensor device and .a third light source. ■ t ^ • . 

25 [0020] . According; to another embodiment of^the 
present' inverrtipn tfte first illumination/observation chan- 
nel is^rmetcl^y^a/ftrstrlight sensitive sensor device and 
by a -light source, <the. second illumination/observation 
;channel : is fprmed r by a second light sensitive sensor 

30 djevice and^e;^nie;light source, and the third illumina- 

; tiorVobservatipnxhannel is formed by a third light sensi- 
tive device and the same light source. 
[0021] ; .;; Accgrding to, a further, embodiment of the 
-invention information on reflectivity, glpssiness and 

35 slope from a .moving surface are extracted: separately 
from the surface element under inspection and based 
on this\ information the surfaces - are; inspected with 
enhanced reliability at less false alarm rate.;* In particu- 
lar, jt~i§< ppssiblp to-discriminate between 3p<Jefects 

40 and ^ceespt§d_.yariations within the appearance pt : the 

:[pp22]^ t : Further, preferred embodjments ; are defined in 
ttiedependent claims. v v rst . ; , tJ , 

vf0023|^:>ln the following, preferred embodiments of the 
45 sHiiven^jye:. griethod and the inventive apparatus will be 
desqribed -with; -reference. ; to the apcompany ing draw- 

i,ingsjn,whicr| >. . ; *■ ; - : . ;u 

Fig. 1 shows the overall concept underlying 

so : ,- * ..^ the method -and the apparatus of. the 

,) u ; - - present invention; 4 

Fig. 2a-c illustrate how light is scattered from a 

, . f ; surface dependent from the reflectiv- 
55 1 0t> ity, glossiness and slope, respectively. 

of the surface; , : ^ . 

, ...... ^ . . . t. r , - . 

Fig. 3- t * r shows a first embodiment of the inven- 
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tive apparatus; 

Fig. 4 shows a second embodiment of the 

. inventive apparatus; 

Fig. 5a and b illustrate the influence of the angle of 
illumination for detectioaof 3DTdefscts 
in specular surfaces .under dark field 
condition; 

Fig. 6 shows an arrangement .of the light 

sources for detecting 3D^defects in the 
, surface which .are orientated perpeo- 
, dicular to the -direction ofmotion of the 
surface; . r , ; 



Fig : 7a , 

Fig. 7b. 
Fig.8 . 

Fig. 9 t 
Fig, 10 

Fig. 11 

■* z. '• .\ * . 
Fig., 12a. >i? 

Fig. 12b, . 

Fig. 12c - 



- shows a preferred embodiment of- the 

- inventive apparatus: with integrated 
fibre optics;- .; j . - . . - j • ^ 

, shows a side view of the apparatus of 
the Fig. 7a; ; : f { * r - ? 

shows an example of-a fibre, optic, for 
illumination of the t surface element 
under inspection; ;; -.- . : 

shows an arrangements of s a f ibretopjic 
and lamps; ~ „ ; . 

shows an arrangementfor. deriving the 
beams of light of different color from a 
single light. source; ~ h ; 

^illustrates the,signal process^g.chain 
: a for detection of anomalies based on 
j.v tie obtained signal ;- ; : : - 

.-a o-Shpws a photographic representation 
^obtained from the first dark field chan- 

■:• ne'L; ■ • ■■ : i-^ 

shows a photographic representation 
. .obtained from the second idark .fi eld 

channel; and .. . - ; ■ • ;-* 
' ■ \ 

• shows a. photographic representation 
showjng, 3D-defects Jn the surface 
..obtained from the Images shown in 
Fig. ; 1 2a and Fig. 12b by applying the 
- steps described in Fig. 1 1 . 



[0024] With respect to Fig. 1 the overall concept 
underlying the inventive method and the inventive appa- 
ratus for automatic ; inspection of surfaces will be 
described. With the .measurement step S100 an image 
of the moving surface under inspection is acquired. The 
apparatus schematically shown at step S100 in Fig. 1 
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.will be described with reference to Fig. 3 hereinafter. In 
step S102 physical properties of the inspected surface 
element , are estimated on the basis of the acquired 
image. In step S104 anomalies in the physical proper- 
ties of the surface are detected. In step S106 specific 
.features are extracted and in step S108 the detected 
regions are classified. Finally in step SllOa decision is 
made whether the inspected surface is acceptable, i.e. 
fulfills predetermined requirements with respect to the 
physical properties, or whether the surface exhibits 
defects.. I v . * . ' . 

[0025], According to the present invention the image 
acquired in step S100 is formed .from three different 
images which is illustrated by the arrows 100a, 100b 
and 100c between step S100 and step S102. The three 
images, are represented by three video signals, wherein 
a first signal 100a representing a first image is obtained 
by observing the surface 1o be inspected under a first 
observation condition by means of; a first of at least 
4hree different illumination/observation . channels. The 
second and. the third signals on line ,100b and ,100c, 
..respectively, are obtained, by observing 4he surface 
under a second observation condition by means of a 
; second and a third of the at least three different iliumina- 
.tion/observatipn channels. On the basis of the thus 
obtained : f irst, second and third signals physical proper- 
Jias of the surface elements are derived in step S102. 
[0026] . According to ,a preferred embodiment of the 
present invention information on^reflectivity, color, gloss- 
iness and profile, of the inspected surface is captured by 
an : apparatus with a -color line scan camera and three 
spatially separatee! light spurces.wrth different spectral 
characteristics, following the above.:outlined idea of pho- 
tometric stereo. The result of the image acquisition in 
step S100 are in this embodiment three registered 
images (R, G, B) basically corresponding to three chan- 
nels of illumination.!; In the, above described steps the 
images are processed as follows:-, ; * r 
[0027] In stap St02 the physica! ? proper^y or proper- 
Kties fops each, surface element are-estimated and the 
r ; esult are physical property images representing reflec- 
; tiyity, color, glossiness and slope of the surface element, 
.as it is illustrated by the four arrows between block S102 
ancj block SI 04. These images have the same spatial 
resolution as the originalimage. :> - 

[0028] In step S1 04 the anomalies are. detected. Local 
anomalies within the property images are detected at 
the same spatial resolution as the original image, and 
regional anomalies, .e.g. due to a shallow wave in the 
surface or surface roughness, are detected by comput- 
ing the moving average or the moving standard devia- 
tion of the slope:Of the surface elements followed by a 
comparison of j-'the resulting statistical figures -with 
thresholds. The butput of step S 104 are multiple binary 
images, as indicated by the plurality of arrows connect- 
ing step.3104 and step S106.. - 
[0029] - In step S106 features from the binary images 
generated in step S104 are extracted. Simple or com- 



4 



EP 0 898 163 A1 



8 



plex geometrical features are calculated, such as the 
area arid shape of blobs in trie binary images. In addi- 
tion, neighborhood relations can be taken into account, 
e.g. accumulation of blobs, or the overlap of blobs within 
different layers of the multiple binary images received 
from step S104: 

[0030] In step S108 the classification is carried but 
and the segmented regions of the : detection irnage are 
classified due to the extracted features. - 
[0031] Prior to describing preferred ernbodirnents of 
the inventive apparatus ard thelnventive method; with 
respect to Fig. 2 it is illustrated how light is scattered 
dependent from the reflectivity, glossiness and' slope, 
respectively, of a surface. ' 1 : ' : * 
[0032] The apparatus according to the present inven- 
tion which is used for image acquisition' is, according to 
a preferred embodiment, intended to gafther information 
on reflectivity; glossiness, color and slope of the surface 
elements under inspection. The apparatus and method 
described be!ow are based on considerations as Illus- 
trated in Fig. 2 which shows the way ' hdw light will be 
scattered from a surface element rf it ; is illurhinated by a 
ray of light which is incident brthdgdnal to the inspected 

-■surface. ' - - " - * ; -.-:'c ; - ■ 

[0033] tn Fig. 2a the scattering characteristics with 
respect to the reflectivity of-a surface S are shbwhPlh 
Fig. 2a a beam of light 200 is incident orthogonal td r the 
surface S and light beams 202 f are reerrtrtted from the 
surface S. As can be seen from Fig. 2a a line 204 is 
drawn around the reemitted 'beams 202 indicating We 

dobe of the reflected- light. As; can be seen from FigS2a 
for a low reflectivity of the surface S (left-hand side of 
Fig. : 2a) the energy of the reemitted light will be low, as 
it is indicated by the' small lobe 204' indicating a low vol- 
ume V-j of the reflected flight distribution. \rf case tff a 

' high reflectivity of surface S the energy of reemitted licjht 
will be high, as it is-illustrated by thelarge lotie 204; i.e. 
the volumec V£ of the-reffected light' distribution is fti^h. 
As can be seen from Fig. 2a the shape of the light distri- 
bution, i.e. the lobes 204/willb^ the same. — 
[0034] i .With respect to Fig. 2b the light 'distribution Of 
the reemitted light for a different glossiness of the- sur- 
face S is illustrated. Again a beam fight of 200 is mcident 
orthogonal to the surface S. In case of a low glossiness 
of the surface^S.peft^hand side of Fig.-2b) the light dis- 
tribution as indicated by lobe 204 will be broad. For a 
high glossiness^f surfaces (rigrft-hand'side of Fig. 2b) 
the light distribution, again indicated by lobe 204; will ; be 
slim. The reflected light distribution indicated by the vol- 
umes V-j and V 2 is supposed to-be the same in fcase of 

- a low glossiness of the surface S and for a surface S of 
high glossiness in this example. • * ; 
[0035] In Fig. 2c the reflected light distribution in case 
1 of a slope in surface S is shown. Again a beam ©f light 

/ 200 is incident orthogonal to surface S and the reflected 
light distribution is again indicated by lobe 204, whereas 
the amount of reflected Jight is again indicated by the 
volumes V*i and V 2 . For a horizontal surface element, 
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the light distribution 204 will be symmetrical with respect 
to the surface normal, and it will be tilted if the surface 
element S has a slope 206. The volumes V-j and V 2 are 
the same in both cases. - 

[0036] The different shapes of the lobes 204 and vol- 
umes V 1p V 2 of the reemitted light distribution can be 
discriminated by simultaneously observing the illumi- 
nated surface element with several light sensitive sen- 
sors from different directions. The same will be true, if 
the light source used in Fig. 2 for illuminating the surface 
S with the beam of light 200 is replaced by a single light 
sensitive sensor, like a camera, and if the sensors are 
replace by light sources-' ' 

t0037]* c The apparatus for image acquisition achieved 
by the* above-me'ntioried replacement will be described 
in more detail in Fig. 3. 1 : 

[0038] The apparatus in Fig. 3 is one preferred 
embodiment'of the present invention and is indicated by 
reference sign 300: The apparatus 300 comprises a 
camera C which is a color line iscah camera. The cam- 
era C comprises a lens 304 and a processing section 
'306 -for generating signals representing the received 
images. Section 306 has three outputs R, G, B wherein 
the signals are representing a red image (R), a green 
image (G) arid a "blue image (B). The camera-© is 
■arfarT&ed" above the "surface S to be inspected in^such 
manner that the normal 308 of surface S is coincident 
with the axis of observation 31 0 of the camera C. 
[0039] ' v Further three light sources" L1.L2 and L3 emit- 
ting light beams 312, 314 and 316 of different spectral 
characteristics are provided. Light from the respective 
light sources is Vrewn under ah angle y by the inspected 
line of the'surface. The light beams 312 from the first 
light source L1 are directed via a mirror M towardslthe 
surface S in such a manner that they are incident 
orthogonal onto surfaced The light sources L2 and L3 
are 'arranged such -that the respective beams of light 
314 and 316 emitted from the light sources enclose wfth 
the normal 308 of the surface S an angle p. 
[0040} 'Light source LI is illuminating surfaced under 
brightfield cbhditiOns by means of the mirror M, which 
can be a beam splitting mirror. Light sources L2 and L3 
illuminate the surface S under symmetrical dark field 
conditions: > A bright field condition is a condition under 
"which light emitted, e.g. by light source L1, is reflected 
from a specular surface S back towards the lens 304 of 
camera C. A dark field condition is a condition under 
which; in sase of- a ■ non -defective surface, light, e.g. 
'emitted by light source L2> is. not reflected towards the 
lens 304 "of camera- C from a* specular surface. The 
angle P- and i can be chosen in accordance with the 
demands of the application for optimized sensitivity and 
robustness of the measurements. E.g. for glossy sur- 
faces p has* to be^ small. * - * \ 
[0041] In most applications it will'be possible to avoid 
the beam splitting mirror M and to use a non-symmetri- 
cal* arrangement for Image- acquisition. • Such an 
arrangement is shown as a further embodiment of the 



BNSOOCID: <EP 0898163A1 I > 



5 



9 

inventive apparatus in Fig. 4. 
[0042] In Fig. 4 the same reference signs are used for 
identical elements, which have already been described 
with reference to Fig. 3. The difference between the 
apparatus shewn in Fig. 4 and the apparatus shown in 
Fig. 3 is that the axis of observation 310 of camera C 
and the beams of light 312 emitted from light source L1 
are not coincident with the normal 308 of surface S. The 
axis of observation 310 and normal 308 as well as the 
beams of light 31 2 of light source L1 and the normal 308 
enclose an angle a. - 

[0043] With respect to the above description, of the 
inventive method and the inventive apparatus-it 
becomes clear from the description otthe embodiments 
of Fig. 3 and 4 that in these embodiments.three different 
illumination/observation channels are used wherein the 
first illumination/observation channel is formed, by a light 
sensitive sensor device which is according to Fig. .3 and 
4 the camera C and by the first light source L1, wherein 
the camera C receives light of the first beam 31 2 of light 
reemrtted ; from the surface element S.. The second illu- 
mination/observation;channel is. formed by the light sen- 
sitive sensor device C and the second light source-L2 
and the , light sensitive sensor device 1 or camera -C 
receives light of the second beam 31 4:pf light reemrtted 
from the surface element S. » The : . third ^illumina- 
tion/observation channel is formed by the light sensitive 
sensor device or camera C and the third light source L3, 
and the~camera C receives light of the third beam 316 of 
light reemitted fronvtbe surface: element, S. In. the 
embodiments described with referenced Fig. 3 and 4 
the three beams 312, 314 and 316 of light all have dif- 
ferent characteristics,; and according to a; specific 
embodiment have different spectral .characteristics, :i:e. 
different colors. ■ ' . * v i 

[0044] In.the embodiment described with reference to 
Fig. 3 -and 4: the.second light source L2 and third light 
source L3. operating under a dark- field condition are 
arranged symmetrically with respect to the normal 308 
of surface S or with respect to thefirst beam of.light 312 
emitted from the first ilight source L1. It' is, however, 
noted that the : light sources 12 and L3 can be arranged 
in a non-symmetrically manner. As.to the position of the 
first lamp L1 it is noted that same may deviate some- 
what from the exact specular, direction shown in^Fig.- 4 
without disturbing the bright field condition. Further to 
the described embodiment, the second and the third 
light source can be symmetrically arranged with respect 
to the normal 308 of the surfaced or with respect to the 
first beam of light 31 2 Remitted from the first light source 
L1. . • - ; r r 

[0045] The above described principle underlying the 
present invention is. however.^not restricted to three 
channels of illumination and three color channels of the 
camera, or more broadly speaking* to only three illumi- 
nation/observation channels, but can be. extended to N 
channels of illumination.and observation. 
[0046] The light sources L1 , L2 and L3 may be simply 



10 

colored fluorescent lamps. They can also be rows : of 
halogen lamps equipped with color, filters, or they can 
be built by using collimated fibre optics. The latter reali- 
zation has the^ advantage of a very bright and even illu- 

5 mination of the inspected line of surface S, which is 
necessary^ in high speed, applications, especially 
because the dark field illumination used in photometric 
stereo r requires a lot of light. Besides the above men- 
.tioned fluorescent lamps, any. incandescant lamp, gas 

w discharge lamps (colored or wide spectrum), LEDs, and 
Lasers can be used for illuminating the surface. . 
[0047] The three characteristic angles a, p and.y in the 
apparatus, for image acquisition as shown in Fig. 3 and 
.Fig. 4 can be chosen independently in any of the men- 

15 tioned relationships for illumination. The angle y, has to 
be selected carefully in order to detect shiny defects. 
When using fluorescent tubes, this angle can be deter- 
mined by changing the distance between the lamps and 
rthe inspected; surface or. by adding mirrors behind the 

20 .lamps or by; adding: more fluorescent tubes. v ; 

[0048] -The -used light sources are not point light 
sources Jaut- are somewhat-expanded. In Fig. 3 it is 
assumed that fluorescent tubes are used which extend 
perpendicular to the direction of motion of the surface. 

25 r ln therdirection of motion cof the surface the iextension is 
fdefined by the diameter of. the tubes: Based on the dis- 
tance of the tubes from the observed line on the surface 
and tho diamejer of. the tubes the. angle y (gamma) is 
determined ; under .which, the surface is illuminated by 

30 light? It ; is preferred that the: angle y can be varied as 
shownvin Fig. 5. In~case of fluorescent tubes this varia- 
tion can.be achieved by changing the distance between 
-the 4ub.es and the- surface, ;by„. partially covering the 
tubes or, as shown?in Fig. 5, by arranging a plurality of 

35 tubes*in parallel. • - 

„[0049] Corresponding measurescan be taken if.colli- 
mated fibre line.optics are applied. - 
[0050] , ., With respect to Fig. 5.. the .illumination under 
-dark field ..conditions is explained in^more detail. . 

40 •;[005 ! S];t-.;ln Fig. 5a a.light source 500 emitting a beam of 
ilight 502-is-:used for. illuminating a surface S which is 
rmoyed into a direction which is indicated by arrow 504. 
\iThe incident beam. of. light 502 is reflected at a defect 
portion ,506* of surface S, and the distribution of the 

45 reflected light energy is indicated by means ofJcbe 508. 
•The camera G is arranged above the- surface S in such 
a manner ;that its .axis of observation 310 is coincident 
.with the normal 308rof surface ' — - 

[0052] In Fig. 5b a similar arrangement is shown, in 

50 which the light source 500 is replaced by three- light 
sources ,500a, 500b ».and 500c emitting respective 
beams of light 502a, 502b and 502c which results in a 
distribution of the reflected energy as indicated by iobes 
508a,;508b and 508c. The light sources 500a, 500b and 

55 500c are formed by a multiple fibre optic. From a com- 
parisonidLFig. 5a and 5b it becomes clear that a wide 
. angle dark field-illumination with multiple fibre optics as 
shown in Fig. 5b is to be preferred, since the benefits of 
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such an arrangement are an enhanced light level ol the 
illumination and an enhanced probability for detection of 
reflections from shiny defects. 

[0053] It is to be noted that instead of using one illumi- 
nator/color a number of illuminators of the same color 
can be used when their difference of space angle is kept 
relatively small. This can even result in better defect 
contrast on some materials. ■ 
[0054] With an apparatus for image acquisition as it is 
described with reference to Fig. 3 and 4, sloping surface 
elements or steps in the surface under inspection will 
only be detected if the surface normal 308 has a compio- 
nent which is orientated in the direction 302 of surface 
' motion. Steps, which are orientated parallel to the direc- 
tion 302 of motion, cannot be detected. This makes 
such an apparatus well suited even for the inspection of 
profited material, such as extruded profiles', but the 
apparatus is not suited for applications, 1 where down 
web orientated 3D-defects might occur and havfe to 'be 
detected. For such" applications, thfe incident light frbrh 
the dark field illuminators should be orientated cross to 
the direction of -motion, rather than parallel.' Such a ? type 
of illumination can be realized by a side 1 iltumiri&tiOn, 
which will be described subseqaentfy iri hnbf6 detail With 
reference to Fig. 6. ° * n^i- , . 

[0055] The apparatus 600 Comprises the^camera C 
which is arranged' above the^surface Si the direction 1 of 
motion of surface S would be but'bf the plane bf Fig- 8. 
Instead of the light sources L1 to L3 used in therembod- 
iments described with reference to Fig;- 3 and '4, the 
apparatus 600 comprises three standard>fibre illumina- 
tors F1", F2 and F3. In- Fig- i6 the field of observation ©f 
the camera C is limited; 'as shofvnby the two dashed 
lines 602 and 604. As darvbe seen from Fig. 6 the illu- 
mination range of fibre illuminator F1- indicated by 
dashed lines 606 and 608 is such that light frornthe first 
illuminator Ft which is -reflected by the sOrface S is 
directed towards camera -C sucrv that illuminator F1 
operates under a bright field condition. Fibre illuminator 
F2 has a range in^which light is emitted , k which is limited 
as indicated by dashed line 610, and itlurriinatorCF3 has 
a' range bftilluminating the surface S wtiichcis lirnitecfcas 
indicated by dashed line 612. Illuminators- F2 and F3 
operate under a dark iield condition, i.e.'inccase of a 
. non-defective surface, the light from illuminators; F2 and 
F3 reflected by a specular surface. S is ^not? -directed 
towards the lens 304 of camera C. The indicated range 
of illumination of illuminators^ and F3 is'aehieved by 
arranging same in a tilted position Xiflder a required illu- 
mination angle. 7 . ' .c 
[0056] Illuminator F1 may be aligned with" camera C. 
Basically the bright field illuminator F1 is positioned in 
the same way as the light source or lamp L1 is in Fig. 4. 
Instead of fibre illuminators F1 , F2 and; F3 ; illuminators 
like halogen lamps with color filters can'be used. 
[0057] This construction is not sensitive to height var- 
iations and vibrations of the surface; but suffers.from a 
sloping illumination profile. Depending on the reflectivity 



of the surface this may or may not be problematic. If the 
surface is not very specular, the uneven illumination can 
be compensated by a proper correction of the resulting 
video signal, without loosing a lot of dynamic range at 
5 the borders of the illuminated area. 

[0058] With respect to Fig. 7 a preferred embodiment 
of a side illumination is described. 
10059] In Fig. 7 those elements which have already 
been described with reference to Fig. 3 and 4 are indi- 
io cated with the same reference signs and a further 
description is omitted. To illuminate the surface S under 
inspection a fibre optic 700 is used. The fibre optic is 
connected via a suited wave guide to a light source (not 
shbwh).~The fibre optic 700 ernitts light under different 
75 ^igles^of illumirtatkSh! 3& dan be seen from Fig. 7b. A 
first plurality ofc light Beams 704 and a second plurality of 
light beams 706 ! are used to achieve a dark field illumi- 
nation^ erf surfaces. As b^omes clear Fig. 7b rays 
or beams 704 and 706; when reflected by a specular 
20 surface S having rio defects are not directed towards the 
lehs 304 -of tsameni C: A plurality of beams 708 is 
directed orthogonal towards the^urface S arid provides 
-the bright fieldlllifmi nation of surface S, since light from 
*>eam 708 directly-reflected towards -the lens oicam- 
25 : era t3: In Rg. 7a the emitted light beams are shown; in a 
^ c ' sstdfe* view aad 'are indicated by reference sign 710. By 
-means bf a tens 7i& orthe like, the light beams are col- 
^!>msited; rr-i ■ hi; ; / . ... ' 
t0060p : -With respect to Fit^ 8 the internal structure of 
30 tftefibre bptfoTOG fe described in more detail; The fibre 
^optio 700 comprises a f irst cover layer 802 and a^second 
cover Jayer^804*:in'between which three fibre layers 806, 
808*and 810:^are sandwiched; Fibre layer 808.com- 
"phsieSi like the remaining fibre layers 806 and 810,apltf- 
35 rality of single fibres 808 to form a bundle of fibres which 
are orientated in the direction as indicated by : arrow 
808b. -Fibre layee 806 also comprises a plurality of fibres 
806a which are arranged in a tilted^position when corn- 
spared witfrthe arrangement of thefibres"808a in layer 
40 808, as it is4ndicated by arrow 806b. Likewise fibcelayer 
. 810 comprises a plurality of fibres 81 0a which are tilted 
with respect to the fibres 808a; in .layer 808, . butin a drf- 
-ferent 'direction, than the tilted fibres 806a in layer 806, 
^asit is'indicated by arrow 810b, In this realization the 
45 different artgles of illumination ape constructed inside of 
•one 'Singled tore illuminator. This is achieved, as shown 
in Fig. 87 by splitting thefibre 700; into several layers 806 
to :810j whereia eachrof the layers 806 to 810 corre- 
sponds to one ofrthe required channels for illumination. 
so -. The different angjes.of illumination ;are achieved by tilt- 
ing the fibres 806a and 8 10a of the respective layer 806 
and 810 into the angle that corresponds to the required 
illumination angle, when taking?Sn ell's law into account. 
• It is noted that more than one layer per angle of illumina- 
55 tion can be. used. Instead of the above described 
embodiment using sandwiched: layers oHibre optics, it 
is also possible to use an arrangement having one fibre 
layer with straight fibres for illurninatibnvunder the bright 
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field condition and to use an integrated pair of fibre lay- 
ers having tilted fibres for the dark field illumination. Fur- 
thermore, three separate fibre layers, for illuminating the 
surface under the bright field condition and under the 
dark field condition may be used. Besides the above 5 
described arrangement providing three different illumi- 
nations of the surface, an arrangement using e.g. two, or 
more of the sandwiched construction of fibre layers ena- 
bles an illumination of the surface in more than three 
directions. 70 
[0061 ] ; It is noted that differently tilted fiber layers can 
be placed into separate illuminators.; That is, instead of 
using one illuminator with three or more, fiber layers, 
three separate illuminators with one or more fibres»can 
be used, each with fibres tilted to proper angles. There- 15 
fore, it is possible to use three, totally separate illumina- 
tors, where each has its own -internal structure, i.e. its 
own tilting angles and as many fibre layers as needed. 
E.g., the ; first jlluminator could hav§ only straightfibres 
and only one layer, the second illuminator could hav^e 20 
fibres tilted -"left" 30 degrees and^qnly one layer, and the 
third illuminator w could have : f fores- tilted, "right" -30 
degrees and, for example, two^layers. In: general; the 
tilted fibre illuminators can produce one. or more. illumi- 
nation directions and can consist of one or* more f tore 25 
layers per illumination direction. ; . , o ;c: Cz . *.:;** 
[0062].. The arrangement shown in Fig, 8vhas,the fol- 
lowing benefits: j. ' - - s j'.y- i'^l 

both the camera and the illuminatorcan be set to.an 30 
angle which is very close to the surf ace-normal. In 
this case, the plane of observation and the plane of 
» j illumination almost coincide and:: therefore the 
, arrangement is not sensitive to height 1 variations ^ 
and vibrations of the surface under inspection , ; : ; - 35 

.the .differently colored light conponents;>-e.g:.-red, 
. ^ green and. blue, will automatically overlap and no 
., > alignment problems arise, and r,-\ . - : ; 

. :. . :r < 40 

v thf» r :structure shown in Fig. 8. is very compact and 
- v -consists of only one^ fibre line and one cylindrical 
Jens.(see Fig: 7a). : . ? - m : 0* . 

[0063] In the following,; the power supply fpii illumina- 45 
tion by means of a fibre optic is discussed in detail. The 
dark field illumination, used in Ihe photometric, stereo 
method typically requires a lot of light. The curren* solu- 
tions often apply high frequency or DC powered halo- 
gen lamps for the -dark field illumination. These so 
solutions are inexpensive,, but the spectrum of the halo- 
gen lamps is relatively weak in the visible?. area, espe- 
cially in. the green and blue regions, and much more 
powerful in the near. .infrared and infrared portion of the 
spectrum.:* • .. < 55 
[0064] In high speed imaging, the. spectrally superior 
metal haHde lamps are generally not used; since the 
normal AC powered metal halide lamps produce hori- 



zontal stripes in images, which are known as the 100Hz 
modulation. This modulation Js due to the fact that the 
metal halide lamp is practically-, black between the 
phases of the applied voltage. High frequency and DC 
power supplies for metal halide lamps are very expen- 
sive and typically not even available for short arc lamps 
with more than 100 W of power. 
[0065] With respect to Fig. 9 a new approach using 
metal halide lamps is described. In Fig. 9 a lamp unit 
900 and a control unit 902 is shown. The tamp unit 900 
includes a first, a second and a third metal halide lamp 
LI, 12 and L&which are controlled by respective control 
Elements 902a, 902b and 902c in the control unit 902. 
The control elements 902a through 902c receive via 
lines 904a, 904b .and 904c. a power .The power applied 
to the respective control elements 902a to 902c are dif- 
ferent in phase. Each Jamp LI, L2 and L3 is provided 
with ieither ellipsoid reflectors or ./focusing lenses to 
focus the light emitted from the lamps L1, L2 and L3 to 
: associated filter elements F1, F2 and F3 to provide a 
lamp' unit output, on fibre bundles :908a, 908b and 908c 
of different; color. Optional IR-filters 906a, 906b and 
906c can be used to block the IR-component of light to 
protect the fibre bundles from extra heat. 
[0066] ;,The control , unit 902 controls the metal halide 
Jamps L1 through L3 by a three phase AC power applied 
yja Jines 904a.T 904b and 904c. The lamps are con- 
nected to, a fibre line having the fibre bundles 908a, 
908b and 908c, wherein the fibre line has a randomized 
ftbre : construction. The lamps are connected to the fibre 
line in .groups, of three, lamps-so that each of 'these 
lamps is running at a ; .120\phase shrft compared to the 
:others. lithe fibres are properly .randomized in the fibre 
line, the resulting illumination output is not zero at any 
^time, and this; results in a .reduced amount of ripples in 
the image: The remaining ripples can be easily removed 
from theiimage by well known means of analog or digital 
-signal processing. The arrangement shown in Fig. 9 has 
the benefit that efficient metal halide lamps can be used 
without limiting-and expensive accessoires. * 
[0067J .: In the construction shown in Fig. 9, the,differ- 
-eMy ioolored light components are produced by the 
1 colorj ilters F1, F2 and F3 and separate lamps L1, L2 
and L3 ^are used for each color/ However, such an 
arrangement wastes a lot of illumination power, since 
only av narrow range of the. spectrum is bahdpassed 
through the filter and fed to the fbre line. Instead Off the 
arrangement shown in the lamp unit 900, a preferred 
choice is to use an. arrangement as it wilt be described 
with reference to Fig. 1 0. Further to the above described 
- metal halide lamps any AC-driven; lamps can be used. 
[0068] \ , With respect to Fig, 10 an arrangement is 
shown; which uses only one lamp to produce the three 
.colors. A beam of light 1000 from a lamp (not shown) is 
directed onto a blue-reflective filter. 1002 which transmit; 
.only light of red and green color as indicated by arrow 
:1004 and reflects light of blue color as indicated by 
arrow 1006. The blue light is then again filtered by 
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means of a blue fitter 1 008 and at a first output 1010 the 
blue light is output. The red and green light beam is 
directed to a red-reflective filter 1012 which transmits 
green light as indicated by arrow 1014 and reflects red 
light as indicated by arrow 1016. The transmitted green 
light is passed through a green fitter 1018 and at a sec- 
ond output 1 020 a beam of green light is output. The red 
light reflected by fitter 1012 is directed to a red filter 
1022 and at a third output 1024 atoeamiof red, light is 
output. As can be seen from* Fig. 10 all color compo- 
nents are produced from one single lamp anchinlhfe 
case, the amount of lamps can, in principle, reduce&by 
a factor of three. If appropriate diphroidia filters are 
used; the additional color filters 1008, 1018 and 1022 
are not needed. - , . 

[0069] With respect to Fig. 1 1 the estimation of phys- 
ical' properties of a surface element under Hhspection 
according to the present invention is now desorib'ed. ' 
[0070] Fig. 11 shows a block diagram of thef irst three 
steps 00, S102, and S104 as described with refer- 
ence to Fig. 1. The signals acquired by means the 
camera C are in the described embodiment -signals rep- 
resenting a red image (R), a green image (G) and a blue 
image (B); The three images are input frrto block 1 T0O in 
which a channel separation is - earned -but:' For "the 
description of Fig : 1 1 'it ist assumed that the bright field 
illumination of the surface results 1 in the red image, and 
that the dark field illumination, results in a green image 
for the left channel (light source L2 in Fig: 3)and1n a 
blue Image for the right channel (light source L3 in Fig. 
3). Block? 1100 outputs three separated signals repre- 
sentative of the influence of :the three channels of illumi- 
nation. The signals- XrJ'.Xq "and f x B ^ are input into 
respective filters 1 102. '13 04^ and 1 106, ; as well as into 
respective blocks 11 08, 1 11 0; 1112 for expressing devi- 
. ations in the signals; not as differences from the average 
but as contrast. The calculations^ carried out in block 
1108, 1110 and 1 1.12 are made on the basis of the sig- 
nals received from.*block -1100 and on: the signals 
received from the>. respective filters- >1 102, 1104 and 
1 106 which output an average signal value of the signal 
output- from block vi 00. Block n 1 08 i; outputs a^sighal 
representative of the brightifeld--bloc^ 1-110 outpCrts-a 
signal, representative of "tee- left channel dark field land 
block 1 1 12 outputs a: signal representative of the tight 
channel dark field. These signals aa^ input into blocks 
11 14, £.11t6 andVt18.^Block 11 14 substracts from' the 
bright field the dark field for the left charinel- and for the 
right -channel and outputs a signal representing the 
: glossiness of the inspected . surface element: Block 
1118 forms a difference between the left channel dark 
field and the right channel dark field and outputs a sig- 
. nal representing the slope in the surface under inspec- 
tion. Block 1118 sums the bright! ield and the two^dark 
fields and outputs a signal representative of the reflec- 
tivity of the surface under inspection. The signals indic- 
ative of the -glossiness, slope and reflectivity are input 
into block 1 120 which detects anomalies on the: basis of 
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specific statistics and by thresholding the received sig- 
nals. Block 1 120 outputs further signals for the further 
processing described with reference to Fig. 1, namely 
the feature extraction, the classification and decision. 

5 ; The signals R, G and B from the camera C are also 
input into a color classifier 1 122 which outputs a signal 
indicating miscolored regions of the surface which is 
also used for the further processing of the detection 
images output by block 1 120. 

w -[0071] As becomes clear from the above description 
of Fig. 1 1 , the first aim is to estimate the physical prop- 
erties of the' surface element under inspection from the 
' video signal (R, G, B) of the camera C. 
[0072] Mn general, the^spectral distribution of the three 

is channels R, G, B of -the color iine scan camera C will 
Show some overlap arid/or the spectral distribution of 
the light sources will riot meet ebcactly the color channels 
df the camera G. As'aVesult, there will be some cross- 
talk between the three -channels of illumination which 

20 can* be eliminated by measuring the crosstalk for a non- 
defective surface and substracting for each channel R, 
G, B the respective fractions of crosstalk frorrv the other 
' two Channels, which is 'carried out in block 1 1 00: : ■ : 
:[0073]- tn 1 most Of the applications, it is not necessary 

25 to rcteasure absolute values of figures for the reflectivity 
of the slope bf Ihe surface element under inspection. 
Instead, local deviations from the average iappearance 
bf the? surfafeethave to be detected. This is achieved by 
the stage of adaptive filters 1102, 1104 and 1 1 06 follow- 

30 ing the channel separation 1100. Dependent of the 
< neefds of the ^plication, the filters may e.g. be low pass 
filters or moving average filters: By calculating in blocks 
1 108. 1 1 10 andt112 (x-x)/(x+x) for each channel, the 
deviations- are Qitft expressed as differences fro* the 

35 average but; a£ contrast. The advantage^ is -that* the 
results are not effected by the absolute level of illumina- 
tion or the sensitivity of the camera C. Furthermore, the 
three channels are scaled in the same way, regardless 
of e.g. the changing balance erf the- three -channels of 

40 illumination, which is essential fdr the' following process- 
ing step. 

• [0074] ' The result of the above described stage df sig- 
♦rsaKprocessing are scaled images representing the devi- 
ations from the average appearance for- the three 
45 channels, namely the bright field, the left dark field and 
the right 'dark field. From these images- the reflectivity, 
glossinessvand slope of the surface, element under 
inspection is estimated by blocks 111 4< 1 1-16 and 1118 
as follows:" - t . *£ - t* r. 

so ■ i "- - • : .'■ . <o ; il t • ' -" . 

The reflectivity is^the sunn of all three channels, 
namely the total reflected light energy, the glossi- 
- ~ ness is the bright field minus the sum of the dark 
field, which yields a high glossiness for a slim distri- 
55 bution of reflected light; and a low glossiness for a 
broad distribution of light (see Fig. 2), and the slope 
is determined by forming .the difference between 
the left dark field and the Tight dark field, i.e. by 
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checking the balance of the dark fields or the sym- 
metry of the reemitted light distribution. 

[0075] In conjunction with the output image of the 
color classifier, these three images carry the information 
on the physical properties of the surface in an explicit 
expression with the same spatial resolution as the orig- 
inal image. . . . r 

[0076] Fig. 12 shows an example of the generation of 
an image representing the slope in a surface. With 
respect to Fig. 12a left dark field image and a right dark 
field image are shown as well as the; resulting image 
showing slopes and other 3D-defects on the-surface. 
[0077] Fig. 12a shows the image of the left dark field. 
As can be seen a surface S has some spots 1 200 ther- 
eon, which are e.g. oil spots. Fig. 12b shows the image 
of the right dark field which is substantially identical. Fig. 
12c illustrates the resulting image after .the method 
described with reference to Fig. 1 1 has been applied. 
What can be seen in Fig. 12c is the surface S without 
the oil spots which, are suppressed, and that; the 3Q- 
structure of the surface is shown in detail. The image 
shown in Fig. 12c is the output of block 1116 £ind called 
a. relief image. - ■ - * ^ . 

[0078] Anomalies in the inspected surface, defect can- 
didates, can-be detected by simply; thresholding the 
images representing reflectivity, - glossiness, slope or 
coior (see block 1120 in? Fig. 11). Fcr some classes of 
defects this will not be the appropriate method for defect 
detection, e.g. for waves, shallow.sloping regions on the 
surface, or for estimation of surface roughness. For 
such types of defects it is advantageous to, apply statis- 
tical measurements, which are tailoredtto the character- 
istic features of the considered classes of defects. E.g. 
the mean value of the slope image: formed: by block 
1116 is; calculated within a moving window fofcdetection 
of shallow sloping regions, or the standard deviation of 
the slope image formed by block 11.16 within a moving 
window is calculated for estimation of the surface rough- 
ness. Theisize of the moving window is adapted to the 
size. of the considered class of defects. For7each pixel, 
the .results of, the statistical measurements, are com- 
pared with a threshold. I . ... M, 
[0079] The result of this stage of signal processing are 
detection images which c^rycorKlensed -information on 
local or regional anomalies of the inspected surface, 
related to the physical properties reflectivity, glossiness, 
slope and color. It is the advantage of the present inven- 
tion that : thts information can be -extracted with high reli- 
ability, high speed and high spatial resolution. 
[0080] Jn the.following, the application of the inventive 
method and the inventive apparatus to a~ steel produc- 
tion will be described. 

[0081 ] Automatic visual inspection is used in steel and 
other metal (aluminium, copper) rolling mills to replace 
and aid visual inspections made by operators. The typi- 
cal characteristics of rolled; flat strip have large varia- 
tions: 



- width 1 00 mm - 250Q mm, : 

- thickness "0.1 mm - 25 mm, and 

- process line speed 5 m/min - 1500 m/min. 

5 [0082] The strips need to be inspected in several proc- 
ess stages during the manufacturing to prevent the pro- 
duction of scrap: 

r hot rolling (T: 500°C - 1000°C), ' 
10 : pickting and annealing processes (T < 100°C), 

- < cold rolling (T < 50^C), 

coating (galvanizing, tin plating, painting,- T< 

- 100°C), 

- cutting and. splitting, and 

is - . o, final inspections before the delivery to customers, 
- often special inspection lines are used. 

[0083] There are a large number of various visual sur- 
face defects being critical for the quality of the strip: 

-r,- metallurgical defects caused, by. impurities and 
- .weaknesses in the internal structure of the metal 
*■ that have become visible during the rolling proc- 
:; : esses (e.g. slivers, scales slags and through holes), 
25 - v defects caused by.the rolling processes like repeat- 
ing roll marks, dents, scratches and uneven coat- 
ing, and - L 
defects caused by the mechanical handling. 

30 [0084] The defect lengths and widths can vary from 
0.1 mm up to several meters. Many defects are elon- 
gated in the rolling " direction so typically the defect 
-length is bigger thanits width/ Often the critical defects 
are not flat but have three dimensional shapes due to 

35 broken surface or local dents. The defect depths vary 
-from tens of microns-to through holes. 
[0085]. The visual appearance of a defectless metal 
strip is seldom homogeneous. There are typically dirt 
stripes, oil spots, uneven reflectance and.texture on the 

40 isurface that can" be easily confused with- the-real 
defects: Often the human inspectors' have to' stop the 
istrip and touch the surface by hand to-find out if the 
defect has critical 3D-characteristics.. At higher- line 
speeds human ; visual inspections are- very unreliable 

45 and no 1 00% inspection can be guaranteed. 

[0086] There are continuously increasing' trends to 
improve the: quality of the metal strips driven- by 
demanding customers like automotive' industries using 
thinner strips and targeting to high quality. ' 

so [0087] It has proved very, difficult to apply automatic 
optical inspection in metal strip manufacturing. There 
. are^ several systems in the market "using either laser 
scanning or CCD line scan cameras' but no real break- 
• through has been reached. Often the systems have sev- 

55 eral cameras (or detectors) to view the surface from 
different directions but their capabilities to analyze the 
3D shapes of the defects are very limited. Basically the 
systems based on the current 2D-technology are capa- 
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b!e to detect the defects but they are not good enough 
to discriminate between real defects and non-important 
"pseudodefects". The complicated image processing 
and pattern recognition -methods are used in defect 
analysis and classification to compensate the weak- 5 
nesses in the basic measurement. Every, defect type 
needs its own. parameters and laborous and time con- 
suming "teaching" periods are needed to train the auto- 
matic inspection system. Even in the best cases it takes 
a long time and needs great efforts to reach satisfactory to 
results. As a consequence, most of the metal rolling 
mills have no resources to apply the current .surface 
inspection technology. ~, - * ■ . 

[0088] The present invention improves decisively the 
quality of the measurement signal producing a much 15 
more viable basis to automatically identify the critical 
defects. The possibility to directly measure the 3D-char- 
acteristics of defects will shorten drastically the start-up 
periods of the systems being the major-hindrance bf'the 
current technology. Also the detection performance- of 20 
small defects is improved due to better measurements. 
[0089] : In the above described preferred embodiments 
the surface was illuminated by-light -of different ^colors. 
The present invention is however notiimited to these 
characteristics of the used light beams. Instead of light 25 
of different color.:light having a different polarization can : . 
be used. *;■ *.;• ; . .. 

[0090] The above described preferred embodiments 
of the present invention use bnty 'one color line scan 
camera and multiple channels of illumination, and the 30 
signal acquisition and processing is based on the Idea 
of photometric stereo. : .„ — , v .-- 
[0091 ] In a further. embodiment (not shown) it is pos- 
sible to use instead of the arrangement shown in Fig. 3 
and 4 an arrangement: which uses one illumination 35 
source and a plurality of sensor devices, like cameras 
each outputbng one signal. In -this case, the first illumi- 
nation/observation channel is formed by a first ligM Sen- 
sitive-sensor device anct a tight source, wherein the first 
light sensrtrve sensor device receives light of a first char- 40 
actensjic reemrtted from the= surface element, wherein 
the first . light source illuminates .the' purface element. 

. The second illumination/observation channel is formed 
by a second light sensitive sensor device andthe/ight 
source,., wherein the . . second light sensitive sensor 45 
device receives flight of a secondxharacteristic reemit- 

. ted ;.frpm,i» -the : *. surface, element. - The r third iilumSna- 

, tion/observation channel is in this embodiment formed 
by a third J ight; sensitive sensor devrce and the flight 
source, wherein the third light sensor .device receives so 

. light of a third characteristic -reemrtted from the sutfacte 
element. With other words, this embodiment uses :only 
one light source.and three light sensitive sensor devices 

• receiving reemitted light of different characteristics from 
the surface. The first, second and third. light sensrtrve ss 
sensor devices.are spatially separated from each other. - 
- :.: *.*.■ . 1* 



Claims 

1 . Method for automatic inspection of moving surfaces 
using at least three different illumination/observa- 
tion channels, said method comprising the steps of: 

a) observing said surface (S) to be inspected 
.« ; under a first observation condition by means of 
a first of said at least three illumination/obser- 

• vation channels to obtain a first signal (R); 

- - . b) observing said surface (S) under a second 
, observation- condition by means of a second 

* and a thirdof said at least three different illumi- 
^ nation/observatiori charinels to obtain a second 

• : * signal (QJ and^a third signal '(B); and 



. ' c) deriving from *said first,* second and third sig- 
nals. (R, G, B) a physical property of said sur- 
face (S). ' \ " *■-' . : : 



2^ Method according to claim 1 . wherein - 

\.r; *• r : '"Vi.. • -*.^'. * * . . i 

■✓;?:{■.■*;• : *step a) comprises the step of illuminatirig ? said s & 
surface (S) by a first beam of light (3 12)*: said * 
i. :.: first illumination/observation channel. being ri 
..v c;i formed by flight- sensrtiveJserisor device (G) % 
c t ancba*f rrst tight source (L1), said light sensitive - 
\: ... : ;; ( sensori device (C) receiving light of the first 

: beam of light ;reemitted from said surface ele- • 
:- < ■ .. ment (S^/and 

*■ t . .stepiajj comprises the step oHlluminating said ~^ 

- . - surface (S)-by-a second beam of light (3 1 4) and :A 

r: -by aithircfcbeam oNight (316), saidfirst, second -3 

v. 7'* andthird.beams of light (312, 314, 316) having 'ti 



^different characteristics, said secondhand third 
r \ ilfumination/observationi 1 phannete * being 
y .-formedixy said light sensitive seinsor devrce (C) 
? ;and a second and athird light'source (L2, L3), 
rf.r .* respectively/ said niight sensitive sensor device 
.5 q r . ;.(C>:receiving light ofc the second beam- of light 
r t: .^and light of;the third bearrtof light, respectively, 
reemitted from said surface (S). ^ 

Z. Method according, to daim 2, wherein said first, 
t rsecond and third beam ofclight (312, 314, 316) have 
r . . different spectral characteristics. • 
. ; * x ,-1 /.--*. * 

4, Method according to any of claims 1 to 3, wherein 
said first Dbservation condition is a bright field con- 
dition,, and said- second observation condition is a 
dark field condition. 

5. * Method according to any of claims 2 to 4, wherein 

* - said illumination of said surface (S) by< said second 

• ^ and third beam: of ..light (314, 316) is . symmetrical 
: * ^ with respect to the f irstbearn of light (312) iltuminat- 
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ing said surface (S). with respect to the normal 
(308) of the surface (S), or with respect to the direc- 
tion of observation (310). 

Method according to any of claim? 1 ^}- ^^ 
said physical property of said surface (S denved 
from said first, second and third signals (R. G. B) 
includes reflectivity/ glossiness and slope of said 
surface (S). - 
Method acxioiding to claim^6, wherein- 

information on said; reflectivity bf said surface 
(S) is derivedfrom the sum of the first, second 
and third signal; 

* information* on 'said gte^e^Vwidsuyfaw 
(S) is derived from the first signal minus the 
- sum of.the second and third .signals; and ? 

'"."" information on said slope of Said s'urfaceXS) is 
derived from the difference of the second and 
the third signals. „ ... . _ ..... . 

. Method according to daim T^co^Kg^ fo^ m^-' 
ing steps prior to deriving information on the reflec- 
tivity, glossiness and slope said surface (S). _ 

- f iltering the first, second'and third signal; and ^ * ; ~_ 

- '. calculating fiorinalized^^tffs 1* : eacrrsig- 

. ,* nal to scale the signals in the'^ame way. ^ 

9. - Method according to "any pf! clairn4; 1 to r 8. compris- 
ing the step of . • I .. .. 

: . .. ...detecting anomalies of the surface (S) on the 

:,...*••' derived physical property. ' " ^ 

io: : Method according to claim s. ^eirV said step of «>=>- 
detecting comprises the following steps: 

calculating statisticalleatures froftrthe derived- 
physical property, and ,, , ,., n r . 

comparing the derived physical property with a 
■ ..; .threshold; ; •, • 

11. Method according to claim i wherein 
' ' . - said surface isjljuminatea t^ ' a beam of light; 

said first illuminatiorVobservatipn channel is 
formed' by aJirst light sensitive; sensor device 
. and a fight source, said first.'liqht sensitive sen- ss 

sor device receiving in steps a) light of a first 
characteristic reemitted from said surface ele- 
ment; and 



.-. 22 ... 

said second and third.illumination/observation 
. channels are formed by a second and a third 
light sensitive sensor device .and said light 
source.' said second and third light sensitive 
sensor device receiving in step b) light of a sec- 
J . " " ond and a third characteristic, respectively, ree- 
mitted from said surface, said first, second and 

third iight sensitive sensor devices being spa- 
tially separated from each other. 

12. Apparatus for automatic inspection of moving sur- 
*• faces, comprising . . 

• a first illumination/observation channel for 

observing a said surface (S) to be inspected 
under a first observation condition to obtain a 
first signal (R); 
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a second illumination/observation channel for 
■ observing said surface. (S) under a second 
,- . observation condition to obtain a. second signal 
(G); .. , 

- a third illumination/observation channel for 

- - observing .said surface (S) under said second 

observation^condition to obtain a third signal 
(B);and . ., - .... : 

- means for deriving a physical property of said 
-. surface (S) from saidfirst, second and third sig- 

.. i.nals (R, G.,B).,.^ 

Apparatus according to claim .12. wherein 

■ said, first illumination/observation channel te 

- - formed by a light- sensitive sensor device (C) 
'and a first light source (L1) illuminatjng said 

surface (S) with light of a first spectral charac- 
teristic said first observation condition being a 

■ bright field conditi6n. said light sensitive sensor 
:.' 'device (G) receiving reemitted light of the first 

k spectral.characteristic; ■ ■ , . 

said secondiHuminatioiVobservation channel is 
formed by said light sensrtive sensor device (C) 
• anda second lightsource^jlluminatingsa.d 
surface (S) with light of a second spectral char- 
acteristic, said second spectral character.stic 
• being different from said first spectral charac- 
teristic. saW second observation condition 
being a dark f ield condition, said light sensitive 
sensor device (C) receiving reemitted light of 
the second spectraLcharactertetic:,aod 

said third illumination/observation channel 
being formed by said light sensitive sensor 
device (C) and a third light source (L3) illumi- 
nating said surface (S) with light of a third spec- 
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tral characteristic, said third spectral 
characteristic being different from said first and 
second spectral characteristics, said light sen- 
sitive sensor device receiving reemitted light of 
the third spectral characteristic. • 

14. Apparatus according to claim 13, wherein said sec- 
ond and third light source (L2, L3) are arranged 
symmetrically with respect to' a light beam (312) of 
said first light source (L1), with respect t6 the nor- 
mal (308) of the surface (S), "or with respect to the 

. direction of observation (310). 

■■ ! - : - -■ • \ ■■/* ::r 

15. Apparatus according to any of cairns T2;.to 14, 
wherein said physical property of said surface (S) 
includes reflectivity, glossiness and slope of said 
surface (S). * -** ■ V J v ■.•"-«.:* 

16. Apparatus according to claim i-T5;;- wherein said 
means for deriving a physical property comprises: 

' ^ j? 

means" (11 18)- for summing' the first, second 
and third signal to provide a~signal representing 
the reflectivity of said surface (S) ; 

means (11 14) for forrrifftg a difference between 
the first signal and the slim of the second and 
' third signal to provided signal representing the 
glossiness of said surface (S); and J 

means (1 1 idyforforminfcj a difference between 
the second arid third sigriai to provide a signal 
representing the slope of said surface (S). 

17. Apparatus according to any <tf claims 12 to 16, 
wherein said means for deriving a physical property 
comprises means' (1120)10^ detecting anomalies of 
said surface (S)' based oh the' derived physical 
property. / " JC ; * i ? 

18. Apparatus according to afly^of claims 13 to 17, 
Wherein said first, secbhd -and third light sources*, 
are formed by orie or 3 plurality of fibre optic means, 
each fibre optic means having ^ al ;l east one fibre 
layer, the fibre optic means and the fibre layers 
thereof being arranged such that light ol said first, 
second Brid'tfiird flghi sources illuminates said sur- 
face under predetermined illumination angles. 

19. Apparatus according to any- of > claims 13 to 17, 
wherein said first, second and third light sources 
are. formed by f fere 'optic means (700), said fibre 

. optic means comprising at-1east three layers (806, 
J808, 8i0)~ a first layer -(806) providing light of the 
first spectral characteristic, a second layer (808) 
providing light of the second spectral characteristic 
and a third layer (810) providing light of the third 
spectral characteristic, wherein said lirst and third 



layer (806, 81 0) are tilted with respect to the second 
layer (808) such that light of the first and third spec- 
tral characteristic illuminates said surface under 
predetermined illumination angles. 

5 

20. Apparatus according to any of claims 13 to 17. 
wherein said first, second and third light sources 

. ;i are formed by a first and a second fibre optic 
. means, .said first fibre optic means comprising at 
10 least one layer providing light of the first spectral 
characteristic, said second fibre optic means com- 
prising at least two layers providing light of the sec- 
ond spectral, ^characteristic and the third spectral 
characteristic/ wherein said fibre layers of the see- 
rs ; qnd t f jbre optic means providing the light of the sec- 
v f , w ond and third qharaSeristie are tilted with respect to 
the layer of trie first fibre optic means such that light 
of the second and third spectral characteristic illu- 
„ ^ minates $aid surface under predetermined illumina- 
te ~ : .tion angles!* ~ ■ r. . . 

21. Apparatus according to any of claims 13 to 17, 
•\ ^herein said first, second and third light sources 
^ . * ~ .fprrpnse^C connected to rand- 

25 omized f fire line (908a, 908b, 908c) in groups (900) 
of three lamps, wherein each lamp is controlled to 
: , operated, at a .120° phase shift with respect to 
, : , } . : r -the rernaixiina^twp lamps. 

30 22. Apparatus according to any of claims -21 . wherein 
said .ACidriven lamps are metal halide lamps. 

23. ^pparajus^atxjprding to any of claims 13 to 17, 
wherefn r sajd first, second and third light sources 
35 are forme&lby a lamp, said lamp comprising a beam 
splitter m^ans (1002, 101 2) to obtain at least three 
different light beams (1010,1 020,1 024) having dif- 
ferent spectral characteristics. 

40 24. Apparatus according to claim 1 2-r,* wherein said 
beam splitter me&ns (10u2| r i012)" comprises 
, ... . dichroitic mirrors and filters for the different spectral 
characteristics. 1 ^ 'J* 

45 s . 25, /Apparatus according to claim 12, wherein 

a light sourcels provided for illuminating said 

so said first illumination/observation channel is 

formed by a first light sensitive sensor device 
and said light source, "said first light sensitive 
sensor device receiving light of a first spectral 
characteristic reemitted from said surface; 

55 . . . , 

. , said second illuminatiorvbb'servattion channel is 
formed by a secbhd light sensitive sensor 
'. . device and said light source, said second light 
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sensitive sensor device receiving light of a sec- 
ond spectral characteristic reemitted from said 
surface, said second spectral characteristic 
being different from said first spectral charac- 
teristic; and 5 

said third illumination/observation channel is 
formed by a third light sensitive sensor device 
and said light source, said light sensitivity sen- { 
sor device receiving light of a third spectral io 
characteristic reemitted from said surface, said i 
third spectral characteristic being different from 
said first and second spectral characteristic, 
said first, second and third light sensitive sen- 
sor devices being spatially separated from is 
each other. 

i 
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